(12) United States Patent 

Vallone et al. 



US006642939B1 

(10) Patent No.: US 6,642,939 Bl 
(45) Date of Patent: Nov. 4, 2003 



(54) MULTIMEDIA SCHEDULE PRESENTATION 
SYSTEM 

(75) Inventors: Robert Vallone, Palo Alto, CA (US); 

Howard Look, Mountain View, CA 
(US); Ain McKendrick, Menlo Park, 
CA (US); David Avraham Brown, 
Mountain View, CA (US); Kyrle 
Robinson, Palo Alto, CA (US); Jeffrey 
Ma, Redwood City, CA (US) 

(73) Assignee: TiVo, Inc., Alviso, CA (US) 

( * ) Notice: Subject to any disclaimer, the term of this 
patent is extended or adjusted under 35 
U.S.C. 154(b) by 0 days. 

(21) Appl. No.: 09/539,723 

(22) Filed: Mar. 30, 2000 

Related U.S. Application Data 

(60) Provisional application No. 60/127,178, filed on Mar. 30, 
1999. 

(51) Int. CI. 7 G09G 5/00; G06F 3/00 

(52) U.S. CI 345/721; 725/39; 725/44; 

725/52 

(58) Field of Search 345/768, 720, 

345/721; 348/569, 563, 564, 565-570; 
725/38, 39, 40, 43, 45, 47, 52, 53 

(56) References Cited 

U.S. PATENT DOCUMENTS 

4,600,989 A 7/L986 Schwartz et al 364/200 

4,706,121 A 11/1987 Young 358/142 

5,038,211 A 8/1991 Hallenbeck 358/142 

(List continued on next page.) 

FOREIGN PATENT DOCUMENTS 



EP 
EP 
EP 



0 435 370 A2 
0 691 651 Al 
0 764 951 Al 



7/1991 H03 J/9/06 

1/1996 G11B/27/34 

3/1997 G11B/27/034 



Primary Examiner — Kristine Kincaid 
Assistant Examiner — Thanh T Vu 
(74) Attorney, Agent, or Firm — Glenn 
Michael A. Glenn; Kirk D, Wong 



Patent Group; 



(57) 



ABSTRACT 



(List continued on next page.) 



A multimedia schedule presentation system provides a pro- 
gram guide area which is a list of the programs that are 
currently airing, was aired, or is scheduled. The program 
guide area is semi-transparent and overlays on the broadcast 
program material that the user is currently watching. The 
invention displays the program guide information in two 
different modes: two column or three column. The two 
column mode displays the available channels in a rotating 
endless list fashion in the left hand column and the programs 
for the highlighted channel in the right hand column. The 
current time period is shown above the left column on the 
screen and is easily changed by the user. Below the time 
display is the listing of the channels available to the user. 
Next to each channel number is the station ID and the title 
of the current program that is being aired. A description of 
the current highlighted program is displayed above the two 
columns. The right hand column displays a schedule of the 
programs for the particular channel, beginning at the time 
indicated above the left column. The program name and start 
time are displayed. The program list in the right hand 
column can be shown in two intuitive forms. One lists the 
start time of each program next to the program name in 
descending order from the most recent time to the latest 
time. The second continues the time intervals by listing each 
half, quarter hour, or selectable intervals with duration of the 
program indicated by an indicator extending from the pro- 
gram start time down to the program end time. The three 
column mode adds a higher level column to the left of the 
channel column and contains the sorting methods available 
to the user. The second column presents the available 
channels that correspond to the sorting method with the 
second and third columns consistent with that of the two- 
column method. 

114 Claims, 34 Drawing Sheets 
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MULTIMEDIA SCHEDULE PRESENTATION matioa to the user in a visually and intellectually intuitive 

SYSTEM manner. In addition, the invention provides a system that 

CROSS REFERENCE TO RELATED utilizes a consistent, intuitive user interface. 

APPLICATIONS ^ c inven * lon provides a program guide area which is a 

5 list of the programs that are currently airing, was aired, or is 

This application claims benefit of U.S. Provisional Apph- scheduled. The program guide area is semi-transparent and 

cation No. 60/127,178 filed Mar. 30, 1999. overlays on the broadcast program material that the user is 

BACKGROUND OF THE INVENTION currently watching. The user can see how the program is 

1 Technical Field progressing while he is browsing the program guide sched- 

The invention relates to the interactive display of viewer *° U ^fi ... . iL . , . r 

information in a computer environment. More particularly , The invention di.pl.ys the program guide information id 

the invention relates to interactive user interfaces concerning two dlffercn f m 1 ode f : ^ column or three column. The two 

multimedia program schedule presentations in a computer F^*? A T * i" ' 

environment endless list fashion in the left hand column and the programs 

. ^ . ' fiL n , . 4 „ for the highlighted channel in the right hand column. The 

2. Description or the Pnor Art 15 n j *u u *u u i i* * 

. , . . r . user scrolls or pages up or down through the channel list. 

Multimedia program schedule information has been ^ interfacc ^ consistent throughout all columns with 

physically tied to an archaic display method. Service pro- ct to ^ning an d paging. Whispering arrows are also 

viders are under the false belief that viewers are conditioned in this interface, showing that more information 

to interpret and understand the television schedule presen- exists in the indicated direction. Information is also more 

tation methods that originated from print media such as 20 detailed as the highlight bar is moved to the right (successive 

newspapers. disclosure) as described above. 

Television program schedule information has traditionally ^ current ume period fe shown above lhe left mhlmn on 

been displayed either in a columnar or tabular form. The the ^ ^ iod ^ ^ &d ^ ^ 

tabular method displays program schedule information as a Bclow the Umc di j is the listi of the chan 7 nels avail . 

two dimensional table. The vertical axis displays the tele- ^ abk l0 the ^ Ncxt to cach ch£mnd nurabcr ^ the station 

vision channel numbers and the horizontal axis displays the ID and the title of the current program that is being aired, 

time periods. The names of the television programs for each ^ moves t he highlight bar over the channel that he is 

channel are listed horizontally across the table. Each show interested in and a description of the current program that is 

is listed under the time period during which it is shown. showing on the channel is displayed above the two columns. 

The columnar method displays the channels and program 30 As the user changes the time period, the program titles 

names under a time heading. TV Guide is an example of the change to the names of the program that were, are, or will 

columnar method. This works well for printed matter be shown at that time period. The programs in the right hand 

because the reader looks through the columns for the desired column will also change to correspond to the time period, 

time period and finds all of the channels and program names The user moves the highlight bar to the right hand column 

starting at that time. 35 allowing him to scroll through the programs for that par- 

A dominant television schedule format is the grid format. ticular channel. As each program is highlighted, the pro- 

This format is popular for displaying television schedule gram's information is displayed in the upper area of the 

information on the TV screen. Hie television schedule program guide area. 

information is displayed in much the same form as the ^ ri S ht hand column displays a schedule of the pro- 
tabular approach. A two dimensional table format is laid out. 40 S rams for the P articular channel. The schedule begins at the 
The vertical axis displays the channel numbers or IDs with dme indicated above the left column. The program name and 
the horizontal axis displaying half hour time increments. start time are displayed. The user moves the highlight bar up 
Programs are blocked out within the table. A show is and down the list of programs, scrolling through the time 
represented by a rectangular colored block. This block slots for each da y in the program guide information, 
extends horizontally from the program start time to the 45 The channel number and ID are displayed above the right 
program end time. hand column. The user changes the channel number moving 

The viewer either scrolls through the channel list or it is the channel number backward or forward through the chan- 

rotated automatically. Information beyond the time period is Qel list * ^ channel list in the left ha n d column follows the 

not displayed and only shifts to the right as time advances. user ' s channel selections, scrolling backward or forward in 

The problem with the grid format is that it is limited by 50 th L e channel list. ITie program list in the right hand column 

the television resolution, screen size, and viewing distance. l L 0 P r °g rams associated with the channel number 

This limits the information displayed to approximately one f e l e ^ ted L by l . he user > Startin S at the time indicated above the 

and a half hours and the channel list to around seven left hand column * 

channels. Additionally, some applications attempt to place ^ P r °g ram llst in ^ right hand column can be shown 

advertising information within the grid format. This leads to S5 in two intuitive forms. The first form lists the start time of 

a visual overload of information to the viewer and a cluttered each P r °g ram next to the program name. The list is in 

appearance. descending order from the most recent time to the latest 

It would be advantageous to provide a multimedia sched- hmc ' 

ule presentation system that communicates program sched- ^ sccond form also lists thc slart time next 10 each of 

ule information to the user in a visually and intellectually 60 iht Program names. The list continues the time intervals by 

intuitive manner. It would further be advantageous to pro- Ustin S cach half > c I uarter hour ' or selectable intervals. The 

vide a system that interacts with the user using a consistent, duration of the program is indicated by an indicator extend- 

intuitive interface. m S ^ rom tnc program start time down to the program end 

time. 

SUMMARY OF THE INVENTION 6S The user ca D highlight a program and again move the 

The invention provides a multimedia schedule presenta- highlight bar to the right to obtain a detailed program 

tion system. The system presents program schedule infor- information screen. 
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The three column mode adds a higher level column to the 
two-column mode adding another column to the left of the 
channel column. Two columns are normally displayed at a 
time. The program guide information is sorted in different 
ways, e.g., all movies, favorite channels, all channels, all 
sports, etc. The first column contains the sorting methods 
available to the user. The second column presents the 
available channels that correspond to the sorting method 
with the description of the channel column consistent with 
that of the two-column method. The user simply highlights 
the preferred sorting method with the highlight bar. The 
sorted channels then appear in the right hand column. 

The user can move the highlight bar to the right hand 
column allowing him to scroll through the channels. The 
program information for the highlighted channel is dis- 
played in the upper screen area of the program guide area. 
The user once again moves the highlight bar to the right to 
obtain the two column channel/program format described 
above. This two column format may differ (when a sort 
method other than all channels is selected) in that the 
channels displayed in the left hand column are those that 
correspond to the sorting method. 

Other aspects and advantages of the invention will 
become apparent from the following detailed description in 
combination with the accompanying drawings, illustrating, 
by way of example, the principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block schematic diagram of a high level view 
of a preferred embodiment of the invention according to the 
invention; 

FIG. 2 is a block schematic diagram of a preferred 
embodiment of the invention using multiple input and output 
modules according to the invention; 

FIG. 3 is a schematic diagram of an Moving Pictures 
Experts Group (MPEG) data stream and its video and audio 
components according to the invention; 

FIG. 4 is a block schematic diagram of a parser and four 
direct memory access (DMA) input engines contained in the 
Media Switch according to the invention; 

FIG. 5 is a schematic diagram of the components of a 
packetized elementary stream (PES) buffer according to the 
invention; 

FIG. 6 is a schematic diagram of the construction of a PES 
buffer from the parsed components in the Media Switch 
output circular buffers; 

FIG. 7 is a block schematic diagram of the Media Switch 
and the various components that it communicates with 
according to the invention; 

FIG. 8 is a block schematic diagram of a high level view 
of the program logic according to the invention; 

FIG. 9 is a block schematic diagram of a class hierarchy 
of the program logic according to the invention; 

FIG. 10 is a block schematic diagram of a preferred 
embodiment of the clip cache component of the invention 
according to the invention; 

FIG. 11 is a block schematic diagram of a preferred 
embodiment of the invention that emulates a broadcast 
studio video mixer according to the invention; 

FIG. 12 is a block schematic diagram of a closed caption 
parser according to the invention; 

FIG. 13 is a block schematic diagram of a high level view 
of a preferred embodiment of the invention utilizing a VCR 
as an integral component of the invention according to the 
invention; 
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FIG. 14 is a diagram of a remote control according to the 
invention; 

FIG. 15 is a block schematic diagram of a high level view 
of a preferred embodiment of the invention showing the 
5 viewer interface module interaction according to the inven- 
tion; 

FIG. 16 is a schematic diagram of a central menu screen 
according to the invention; 
1Q FIG. 17 is a schematic diagram of a program list screen 
according to the invention; 

FIG. 18 is a schematic diagram of a detailed program 
information screen according to the invention; 

FIG. 19 is a schematic diagram of a detailed program 
15 information screen according to the invention; 

FIG. 20a is a schematic diagram of a small banner 
displayed over program content according to the invention; 

FIG. 20b is a schematic diagram of a medium banner 
displayed over, program content according to the invention; 

FIG. 20c is a schematic diagram of a detailed banner 
displayed over program content according to the invention; 

FIG. 21 is a schematic diagram of a suggested program 
list screen according to the invention; 
25 FIG. 22 is a schematic diagram of a network listing screen 
according to the invention; 

FIG. 23 is a schematic diagram of a program theme list 
screen according to the invention; 

FIG. 24 is a schematic diagram of a todo list screen 
30 according to the invention; 

FIG. 25 is a schematic diagram of a conflict warning 
screen according to the invention; 

FIG. 26 is a schematic diagram of a trick play bar overlaid 
3S on program material according to the invention; 

FIG. 27 is a schematic diagram of a the trick bar and its 
associated components according to the invention; 

FIG. 28 is a schematic diagram of a two column multi- 
media schedule screen according to the invention; 
40 FIG. 29 is a schematic diagram of a two column theme- 
based schedule screen according to the invention; 

FIG. 30 is a schematic diagram of a two column theme- 
based schedule screen according to the invention; 
4S FIG. 31 is a schematic diagram of a two column theme- 
based schedule screen according to the invention; 

FIG. 32 is a schematic diagram of a two column program 
schedule screen according to the invention; and 

FIG. 33 is a schematic diagram of a two column program 
50 schedule screen showing a program duration indicator 
according to the invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

55 The invention is embodied in a multimedia schedule 
presentation system in a computer environment. A system 
according to the invention presents program schedule infor- 
mation to the user in a visually and intellectually intuitive 
manner. In addition, the invention provides a system that 

60 utilizes a consistent, intuitive user interface. 

The invention provides a program guide area which is a 
list of the programs that are currently airing, was aired, or is 
scheduled. The program guide area is semi-transparent and 
overlays on the broadcast program material that the user is 

65 currently watching. The invention displays the program 
guide information in two different modes: two column or 
three column. Program information is presented in a sue- 
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cessive disclosure format providing the user with more bined to create separate video 308 and audio 309 streams or 

detailed information as he moves to the right in the program buffers. This is necessary because separate decoders are used 

guide area. to convert MPEG elements back, into audio or video analog 

Referring to FIG. 1, a preferred embodiment of the components. Such separate delivery requires that time 

invention has an Input Section 101, Media Switch 102, and 5 sequence information be generated so that the decoders may 

an Output Section 103. The Input Section 101 takes televi- be properly synchronized for accurate playback of the 

sion (TV) input streams in a multitude of forms, for signal. 

example, National Television Standards Committee (NTSC) The Media Switch enables the program logic to associate 

or PAL broadcast, and digital forms such as Digital Satellite proper time sequence information with each segment, pos- 

System (DSS), Digital Broadcast Services (DBS), or *° sibly embedding it directly into the stream. The time 

Advanced Television Standards Committee (ATSC). DBS, sequence information for each segment is called a time 

DSS and ATSC are based on standards called Moving stamp. These time stamps are monotonically increasing and 

Pictures Experts Group 2 (MPEG2) and MPEG2 Transport. start at zero each time the system boots up. This allows the 

MPEG2 Transport is a standard for formatting the digital invention to find any particular spot in any particular video 

data stream from the TV source transmitter so that a TV is segment. For example, if the system needs to read five 

receiver can disassemble the input stream to find programs seconds into an incoming contiguous video stream that is 

in the multiplexed signal. The Input Section 101 produces being cached, the system simply has to start reading forward 

MPEG streams. An MPEG2 transport multiplex supports into the stream and look for the appropriate time stamp, 

multiple programs in the same broadcast channel, with A binary search can be performed on a stored file to index 

multiple video and audio feeds and private data. The Input 20 mtQ a stream Each stream ^ stored 

as a sequence of 

Section 101 tunes the channel to a particular program, fixed-size segments enabling fast binary searches because of 

extracts a specific MPEG program out of it, and feeds it to the uniform timestamping. If the user wants to start in the 

the rest of the system. Analog TV signals are encoded into middle of the program, the system performs a binary search 

a similar MPEG formal using separate video and audio of the storcd segm ents until it finds the appropriate spot, 

encoders, such that the remainder of the system is unaware 25 obtaining mc dcsired rcsuIts ^ a minima] amount of 

of how the signal was obtained. Information may be modu- information. If the signal were instead stored as an MPEG 

lated into the Vertical Blanking Interval (VBI) of the analog strea m, it would be necessary to linearly parse the stream 

TV signal in a number of standard ways; for example, the from the beginning to find the desired location. 

Noitta^erici^ with to na 4 lhe Media Swkch four 

^1° onto hues 10 through 20 of 30 { ^ M Access (DMA) g 

an NTSC signal, while the FCC mandates the use of line 21 A Z- u^aa ■ u ■ . j i_ « « ft j« 

p ™ a r* *• _j |— . . j j t"\ * c • 405 each OMA engine has an associated buffer 410, 411, 

for Closed Caption (CC) and Extended Data Services A ^ A ii . n ur^** i_ • . 

/ri^o\ o u • i j j j u *i_ • * 412,413. Conceptually, each DMA engine has a pointer 406. 

(EDS). Such signals are decoded by the input section and „ u ' it Fm t « t am « ■ . *£\q a r ! 

v ' , x -i: t_ j i- i • a umit t° r tnat pointer 407, a next pointer 408, and a limit 

passed to the other sections as if they were delivered via an f . . , Ann . tx w * • • j j- . j 

wnr/^^ . i « * J 1C for the next pointer 409. Each D MA engine is dedicated to 

MPEG2 private data channel. 35 , « e . c c , -j a M 

r a particular type of information, for example, video 402, 

The Media Switch 102 mediates between a microproces- audio 403, and parsed events 405. The buffers 410, 411, 412, 

sor CPU 106, hard disk or storage device 105, and memory 413 a re circular and collect the specific information. The 

104. Input streams are converted to an MPEG stream and DMA engine increments the pointer 406 into the associated 

sent to the Media Switch 102. The Media Switch 102 buffers buffer until it reaches the limit 407 and the n loads the next 

the MPEG stream into memory. It then performs two opera- pointer 408 and limit 409. Setting the pointer 406 and next 

tions if the user is watching real time TV: the stream is sent p oinler 40 8 to the same value, along with the corresponding 

to the Output Section 103 and it is written simultaneously to limit value creates a circular buffer. The next pointer 408 can 

the hard disk or storage device 105. be ^ t0 a different address to provide vector DMA. 

The Output Section 103 takes MPEG streams as input and 4S 7^ input strcam flows through a parser 401. The parser 

produces an analog TV signal according to the NTSC, PAL, 40 l parses the stream looking for MPEG distinguished 

or other required TV standards. The Output Section 103 events indicating the start of video, audio or private data 

contains an MPEG decoder, On-Screen Display (OSD) segments. For example, when the parser 401 finds a video 

generator, analog TV encoder and audio logic. The OSD eve nt, it directs the stream to the video DMA engine 402. 

generator allows the program logic to supply images which 5Q parser 40 i buffers up data and DMAs it into the video 

will be overlaid on top of the resulting analog TV signal. buffer 410 through the video DMA engine 402. At the same 

Additionally, the Output Section can modulate information time> the parser 401 facets an event to lhe event DMA 

supplied by the program logic onto the VBI of the output engme 405 which generates an event into the event buffer 

signal in a number of standard formats, including NABTS, 4 13t w he n the parser 401 sees an audio event, it redirects the 

CC and EDS. S5 byte stream to the audio DMA engine 403 and generates an 

With respect to FIG. 2, the invention easily expands to event into the event buffer 413. Similarly, when the parser 

accommodate multiple Input Sections (tuners) 201, 202, 401 sees a private data event, it directs the byte stream to the 

203, 204, each can be tuned to different types of input. private data DMA engine 404 and directs an event to the 

Multiple Output Modules (decoders) 206, 207, 208, 209 are event buffer 413. The Media Switch notifies the program 

added as well. Special effects such as picture in a picture can 60 logic via an interrupt mechanism when events are placed in 

be implemented with multiple decoders. The Media Switch the event buffer. 

205 records one program while the user is watching another. Referring to FIGS. 4 and 5, the event buffer 413 is filled 

This means that a stream can be extracted off the disk while by the parser 401 with events. Each event 501 in the event 

another stream is being stored onto the disk. buffer has an oflset 502, event type 503, and time stamp field 

Referring to FIG. 3, the incoming MPEG stream 301 has 65 504. The parser 401 provides the type and offset of each 

interleaved video 302, 305, 306 and audio 303, 304, 307 event as it is placed into the buffer. For example, when an 

segments. These elements must be separated and recom- audio event occurs, the event type field is set to an audio 
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event and the offset indicates the location in the audio buffer 
411. The program logic knows where the audio buffer 411 
starts and adds the offset to find the event in the stream. The 
address offset 502 tells the program logic where the next 
event occurred, but not where it ended. The previous event 
is cached so the end of the current event can be found as well 
as the length of the segment. 

With respect to FIGS. 5 and 6, the program logic reads 
accumulated events in the event buffer 602 when it is 
interrupted by the Media Switch 601. From these events the 
program logic generates a sequence of logical segments 603 
which correspond to the parsed MPEG segments 615. The 
program logic converts the offset 502 into the actual address 
610 of each segment, and records the event length 609 using 
the last cached event. If the stream was produced by 
encoding an analog signal, it will not contain Program Time 
Stamp (PTS) values, which are used by the decoders to 
properly present the resulting output. Thus, the program 
logic uses the generated time stamp 504 to calculate a 
simulated PTS for each segment and places that into the 
logical segment timestamp 607. In the case of a digital TV 
stream, PTS values are already encoded in the stream. The 
program logic extracts this information and places it in the 
logical segment timestamp 607. 

The program logic continues collecting logical segments 
603 until it reaches the fixed buffer size. When this occurs, 
the program logic generates a new buffer, called a Pack- 
etized Elementary Stream (PES) 605 buffer containing these 
logical segments 603 in order, plus ancillary control infor- 
mation. Each logical segment points 604 directly to the 
circular buffer, e.g., the video buffer 613, filled by the Media 
Switch 601. This new buffer is then passed to other logic 
components, which may further process the stream in the 
buffer in some way, such as presenting it for decoding or 
writing it to the storage media. Thus, the MPEG data is not 
copied from one location in memory to another by the 
processor. This results in a more cost effective design since 
lower memory bandwidth and processor bandwidth is 
required. 

A unique feature of the MPEG stream transformation into 
PES buffers is that the data associated with logical segments 
need not be present in the buffer itself, as presented above. 
When a PES buffer is written to storage, these logical 
segments are written to the storage medium in the logical 
order in which they appear. This has the effect of gathering 
components of the stream, whether they be in the video, 
audio or private data circular buffers, into a single linear 
buffer of stream data on the storage medium. The buffer is 
read back from the storage medium with a single transfer 
from the storage media, and the logical segment information 
is updated to correspond with the actual locations in the 
buffer 606. Higher level program logic is unaware of this 
transformation, since it handles only the logical segments, 
thus stream data is easily managed without requiring that the 
data ever be copied between locations in DRAM by the 
CPU. 

A unique aspect of the Media Switch is the ability to 
handle high data rates effectively and inexpensively. It 
performs the functions of taking video and audio data in, 
sending video and audio data out, sending video and audio 
data to disk, and extracting video and audio data from the 
disk on a low cost platform. Generally, the Media Switch 
runs a synchronously and autonomously with the micropro- 
cessor CPU, using its DMA capabilities to move large 
quantities of information with minimal intervention by the 
CPU. 

Referring to FIG. 7, the input side of the Media Switch 
701 is connected to an MPEG encoder 703. There are also 
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circuits specific to MPEG audio 704 and vertical blanking 
interval (VBI) data 702 feeding into the Media Switch 701. 
If a digital TV signal is being processed instead, the MPEG 
encoder 703 is replaced with an MPEG2 Transport 

5 Demultiplexer, and the MPEG audio encoder 704 and VBI 
decoder 702 are deleted. The demultiplexer multiplexes the 
extracted audio, video and private data channel streams 
through the video input Media Switch port. 

The parser 705 parses the input data stream from the 

10 MPEG encoder 703, audio encoder 704 and VBI decoder 
702, or from the transport demultiplexer in the case of a 
digital TV stream. The parser 705 detects the beginning of 
all of the important events in a video or audio stream, the 
start of all of the frames, the start of sequence headers — all 
of the pieces of information that the program logic needs to 
know about in order to both properly play back and perform 
special effects on the stream, e.g. fast forward, reverse, play, 
pause, fast/slow play, indexing, and fast/slow reverse play. 
The parser 705 places tags 707 into the FIFO 706 when 

2Q it identifies video or audio segments, or is given private data. 
The DMA 709 controls when these tags are taken out. The 
tags 707 and the DMA addresses of the segments are placed 
into the event queue 708. The frame type information, 
whether it is a start of a video I- frame, video B -frame, video 

^ P-frame, video PES, audio PES, a sequence header, an audio 
frame, or private data packet, is placed into the event queue 
708 along with the offset in the related circular buffer where 
the piece of information was placed. The program logic 
operating in the CPU 713 examines events in the circular 

30 buffer after it is transferred to the DRAM 714. 

The Media Switch 701 has a data bus 711 that connects to 
the CPU 713 and DRAM 714. An address bus 712 is also 
shared between the Media Switch 701, CPU 713, and 
DRAM 714. A hard disk or storage device 710 is connected 

35 to one of the ports of the Media Switch 701. The Media 
Switch 701 outputs streams to an MPEG video decoder 715 
and a separate audio decoder 717. The audio decoder 717 
signals contain audio cues generated by the system in 
response to the user's commands on a remote control or 

40 other internal events. The decoded audio output from the 
MPEG decoder is digitally mixed 718 with the separate 
audio signal. The resulting signals contain video, audio, and 
on screen displays and are sent to the TV 716. 

The Media Switch 701 takes in 8-bit data and sends it to 

4 5 the disk, while at the same time extracts another stream of 
data off of the disk and sends it to the MPEG decoder 715. 
All of the DMA engines described above can be working at 
the same time. The Media Switch 701 can be implemented 
in hardware using a Field Programmable Gate Array 

50 (FPGA), ASIC, or discrete logic. 

Rather than having to parse through an immense data 
stream looking for the start of where each frame would be, 
the program logic only has to look at the circular event 
buffer in DRAM 714 and it can tell where the start of each 

55 frame is and the frame type. This approach saves a large 
amount of CPU power, keeping the real time requirements 
of the CPU 713 small. The CPU 713 does not have to be very 
fast at any point in time. The Media Switch 701 gives the 
CPU 713 as much time as possible to complete tasks. The 

60 parsing mechanism 705 and event queue 708 decouple the 
CPU 713 from parsing the audio, video, and buffers and the 
real time nature of the streams, which allows for lower costs. 
It also allows the use of a bus structure in a CPU environ- 
ment that operates at a much lower clock rate with much 

65 cheaper memory than would be required otherwise. 

The CPU 713 has the ability to queue up one DMA 
transfer and can set up the next DMA transfer at its leisure. 
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This gives the CPU 713 large time intervals within which it simple logic design that is at the same time powerful enough 
can service the DMA controller 709. The CPU 713 may to support the features described previously, including 
respond to a DMA interrupt within a larger time window pause, rewind, fast forward and others. In addition, this 
because of the large latency allowed. MPEG streams, structure allows fast and efficient switching between stream 
whether extracted from an MPEG2 Transport or encoded 5 sources, since buffered data can be simply discarded and 
from an analog TV signal, are typically encoded using a decoders reset using a single event, after which data from the 
technique called Variable Bit Rate encoding (VBR). This new stream will pass down the pipeline. Such a capability is 
technique varies the amount of data required to represent a needed, for example, when switching the channel being 
sequence of images by the amount of movement between captured by the input section, or when switching between a 
those images. This technique can greatly reduce the required 10 live signal from the input section and a stored stream, 
bandwidth for a signal, however sequences with rapid move- The source object 901 is a TmkSource 906 and the 
ment (such as a basketball game) may be encoded with much transform object 902 is a TmkXfrm 910. These are inter- 
greater bandwidth requirements. For example, the Hughes mediate classes that define standard behaviors for the classes 
DirecTV satellite system encodes signals with anywhere m the pipeline. Conceptually, they handshake buffers down 
from 1 to 10 Mb/s of required bandwidth, varying from 15 the pipeline. The source object 901 takes data out of a 
frame to frame. It would be difficult for any computer system physical data source, such as the Media Switch, and places 
to keep up with such rapidly varying data rates without this it into a PES buffer. To obtain the buffer, the source object 
structure. 901 asks the down stream object in his pipeline for a buffer 

With respect to FIG. 8, the program logic within the CPU (allocEmptyBuf). The source object 901 is blocked until 

has three conceptual components: sources 801, transforms 20 there is sufficient memory. This means that the pipeline is 

802, and sinks 803. The sources 801 produce buffers of data. self-regulating; it has automatic flow control. When the 

Transforms 802 process buffers of data and sinks 803 source object 901 has filled up the buffer, it hands it back to 

consume buffers of data. A transform is responsible for the transform 902 through the pushFullBuf function, 

allocating and queuing the buffers of data on which it will The sink 903 is flow controlled as well. It calls nextFulI- 

operate. Buffers are allocated as if "empty" to sources of 25 Buf which tells the transform 902 that it is ready for the next 

data, which give them back "full". The buffers are then filled buffer. This operation can block the sink 903 until a 

queued and given to sinks as "full", and the sink will return buffer is ready. When the sink 903 is finished with a buffer 

the buffer "empty". (i.e., it has consumed the data in the buffer) it calls relea- 

A source 801 accepts data from encoders, e.g., a digital seEmptyBuf. ReleaseEmptyBuf gives the buffer back to the 

satellite receiver. It acquires buffers for this data from the 30 transform 902. The transform 902 can then hand that buffer, 

downstream transform, packages the data into a buffer, then for example, back to the source object 901 to fill up again, 

pushes the buffer down the pipeline as described above. The In addition to the automatic flow-control benefit of this 

source object 801 does not know anything about the rest of method, it also provides for limiting the amount of memory 

the system. The sink 803 consumes buffers, taking a buffer dedicated to buffers by allowing enforcement of a fixed 

from the upstream transform, sending the data to the 35 allocation of buffers by a transform. This is an important 

decoder, and then releasing the buffer for reuse. feature in achieving a cost-effective limited DRAM envi- 

There are two types of transforms 802 used: spatial and ronment. 

temporal. Spatial transforms are transforms that perform, for The MediaSwitch class 909 calls the allocEmptyBuf 

example, an image convolution or compression/ ^ method of the TmkClipCache 912 object and receives a PES 

decompression on the buffered data that is passing through. buffer from it . It then goes out to the circular buffers in the 

Temporal transforms are used when there is no time relation Media Switch hardware and generates PES buffers. The 

that is expressible between buffers going in and buffers MediaSwitch class 909 fills the buffer up and pushes it back 

coming out of a system. Such a transform writes the buffer to the TmkClipCache 912 object. 

to a file 804 on the storage medium. The buffer is pulled out 4S The TmkClipCache 912 maintains a cache file 918 on a 

at a later time, sent down the pipeline, and properly storage medium. It also maintains two pointers into this 

sequenced within the stream. cache: a push pointer 919 that shows where the next buffer 

Referring to FIG. 9, a C++ class hierarchy derivation of coming from the source 901 is inserted; and a current pointer 

the program logic is shown. The TiVo Media Kernel (Tmk) 920 which points to the current buffer used. 

904, 908, 913 mediates with the operating system kernel. 50 The buffer that is pointed to by the current pointer is 

The kernel provides operations such as: memory allocation, handed to the Vela decoder class 916. The Vela decoder class 

synchronization, and threading. The TmkCore 904, 908, 913 916 talks to the decoder 921 in the hardware, 

structures memory taken from the media kernel as an object. The decoder 921 produces a decoded TV signal that is 

It provides operators, new and delete, for constructing and subsequently encoded into an analog TV signal in NTSC, 

deconstructing the object. Each object (source 901, trans- S5 PAL or other analog format. When the Vela decoder class 

form 902, and sink 903) is multi -threaded by definition and 916 is finished with the buffer it calls release EmptyBuf. 

can run in parallel. The structure of the classes makes the system easy to test 

The TmkPipeline class 905, 909, 914 is responsible for and debug. Each level can be tested separately to make sure 

flow control through the system. The pipelines point to the it performs in the appropriate manner, and the classes may 

next pipeline in the flow from source 901 to sink 903. To 60 be gradually aggregated to achieve the desired functionality 

pause the pipeline, for example, an event called "pause" is while retaining the ability to effectively test each object, 

sent to the first object in the pipeline. The event is relayed The control object 917 accepts commands from the user 

on to the next object and so on down the pipeline. This all and sends events into the pipeline to control what the 

happens a synchronously to the data going through the pipeline is doing. For example, if the user has a remote 

pipeline. Thus, similar to applications such as telephony, 65 control and is watching TV, the user presses pause and the 

control of the flow of MPEG streams is asynchronous and control object 917 sends an event to the sink 903, that tells 

separate from the streams themselves. This allows for a it pause. The sink 903 stops asking for new buffers. The 
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current pointer 920 stays where it is at. The sink 903 starts capture should end. The starting and ending indicators may 

taking buffers out again when it receives another event that be explicitly modulated into the signal or other information 

tells it to play. The system is in perfect synchronization; it that is placed into the signal in a standard fashion may be 

starts from the frame that it stopped at. used to encode this information. 

The remote control may also have a fast forward key. * With respect to FIG. 12, an example is shown which 
When the fast forward key is pressed, the control object 917 demonstrates how the program logc scans the words con- 
sends an event to the transform 902, that tells it to move tamed Wll ^ in < he closed ^ ll0n (CQ fields to determine 
forward two seconds. The transform 902 finds that the two f ^ eDdl ?S tira A es > usm S P^kiUw words or phrases 
j • c , „ to trigger the capture. A stream of NTS Cor PAL fields 1201 
second time span requires it to move forward three buffers. ^ c £ b afC ^ acicd from cach odd field 
It then issues a reset event to the downstream pipeline, so io ^ and entered ^ circular ^ ^ ^ si b 
that any queued data or sUte that may be present in the the Word Parser 1204 ^ Word Parser 1204 
hardware decoders is flushed. This is a critical step, since the characters until it encounters a word boundary, usually a 
structure of MPEG streams requires maintenance of state spacC) period or other delineating character. Recall from 
across multiple frames of data, and that state will be ren- above, that the MPEG audio and video segments are col- 
dered invalid by repositioning the pointer. It then moves the ™ i ected j nlo a ser i es Q f fbced-size PES buffers. A special 
current pointer 920 forward three buffers. The next time the segment is added to each PES buffer to hold the words 
sink 903 calls nextFullBuf it gets the new current buffer. The extracted from the CC field 1205. Thus, the CC information 
same method works for fast reverse in that the transform 902 preserved in time synchronization with the audio and 
moves the current pointer 920 backwards. video> and cari be correctly presented to the viewer when the 

A system dock reference resides in the decoder. The 20 stream is displayed. This also allows the stored stream to be 

system clock reference is sped up for fast play or slowed processed for CC information at the leisure of the program 

down for slow play. The sink simply asks for full buffers logic, which spreads out load, reducing cost and improving 

faster or slower, depending on the clock speed. efficiency. In such a case, the words stored in the special 

With respect to FIG. 10, two other objects derived from ^ segment are simply passed to the state table logic 1206. 
the TmkXfrm class are placed in the pipeline for disk access. During stream capture, each word is looked up in a table 
One is called TmkClipReader 1003 and the other is called 1206 which indicates the action to take on recognizing that 
TmkClipWriter 1001. Buffers come into the TmkClip Writer word. This action may simply change the state of the 
1001 and are pushed to a file on a storage medium 1004. recognizer state machine 1207, or may cause the state 
TmkClipReader 1003 asks for buffers which are taken off of 3Q machine 1207 to issue an action request, such as "start 
a file on a storage medium 1005. A TmkClipReader 1003 capture", "stop capture", "phrase seen", or other similar 
provides only the allocEmptyBuf and pushFullBuf methods, requests. Indeed, a recognized word or phrase may cause the 
while a TmkClipWriter 1001 provides only the nextFullBuf pipeline to be switched; for example, to overlay a different 
and releaseEmptyBuf methods. A TmkClipReader 1003 audio track if undesirable language is used in the program, 
therefore performs the same function as the input, or "push" 35 Note that the parsing state table 1206 and recognizer state 
side of a TmkClipCache 1002, while a TmkClipWriter 1001 machine 1207 may be modified or changed at any time. For 
therefore performs the same function as the output, or "pull" example, a different table and state machine may be pro- 
side of a TmkaipCache 1002. vided for each input channel. Alternatively, these elements 

Referring to FIG. U, a preferred embodiment that accom- may be switched depending on the time of day, or because 

plishes multiple functions is shown. A source 1101 has a TV ^ of other events. 

signal input. The source sends data to a PushSwitch 1102 Referring to FIG. 11, a PullSwitch is added 1104 which 
which is a transform derived from TmkXfrm. The Push- outputs to the sink 1105. The sink 1105 calls nextFullBuf 
Switch 11 02 has multiple outputs that can be switched by the and releaseEmptyBuf to get or return buffers from the 
control object 1114. This means that one part of the pipeline PullSwitch 1104. The PullSwitch 1104 can have any number 
can be stopped and another can be started at the users whim. 45 of inputs. One input could be an ActionClip 1113. The 
The user can switch to different storage devices. The Push- remote control can switch between input sources. The con- 
Switch 1102 could output to a TmkClipWriter 1106, which trol object 1114 sends an event to the PullSwitch 1104, 
goes onto a storage device 1107 or write to the cache telling it to switch. It will switch from the current input 
transform 1103. source to whatever input source the control object selects. 

An important feature of this apparatus is the ease with 50 An ActionClip class provides for sequencing a number of 

Which it can selectively capture portions of an incoming different stored signals in a predictable and controllable 

signal under the control of program logic. Based on infor- manner, possibly with the added control of viewer selection 

mation such as the current time, or perhaps a specific time via a remote control. Thus, it appears as a derivative of a 

span, or perhaps via a remote control button press by the TmkXfrm object that accepts a "switch" event for switching 

viewer, a TmkClipWriter 1106 may be switched on to record 55 to the next stored signal. 

a portion of the signal, and switched off at some later time. This allows the program logic or user to create custom 

This switching is typically caused by sending a "switch" sequences of video output. Any number of video segments 

event to the PushSwitch 1102 object. can be lined up and combined as if the program logic or user 

An additional method for triggering selective capture is were using a broadcast studio video mixer. TmkClipReaders 

through information modulated into the VBI or placed into so U08, 1109, 1110 are allocated and each is hooked into the 

an MPEG private data channel. Data decoded from the VBI PullSwitch 1104. The PullSwitch 1104 switches between the 

or private data channel is passed to the program logic. The TmkClipReaders 1108, 1109, 1U0 to combine video and 

program logic examines this data to determine if the data audio clips. Flow control is automatic because of the way the 

indicates that capture of the TV signal into which it was pipeline is constructed. The Push and Pull Switches are the 

modulated should begin. Similarly, this information may 65 same as video switches in a broadcast studio, 

also indicate when recording should end, or another data The derived class and resulting objects described here 

item may be modulated into the signal indicating when the may be combined in an arbitrary way to create a number of 
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different useful configurations for storing, retrieving, specific segment of the recorded video while the external 
switching and viewing of TV streams. For example, if VCRs are being loaded with the real-time input video, 

multiple input and output sections are available, one input is Referring again to FIG. 1, a preferred embodiment of the 

viewed while another is stored, and a picture-in-picture invention provides a viewer interface that allows the viewer 

window generated by the second output is used to preview 5 to access different functions of the system. The system's 

previously stored streams. Such configurations represent a construct allows items called video loopsets to be stored on 

unique and novel application of software transformations to the nard disk or storage device 105. The video loopsets enter 

achieve the functionality expected of expensive, sophisti- the system through input streams into the Input Module 101 

cated hardware solutions within a single cost-effective and converted to MPEG streams and placed onto the storage 

device. io device by the Media Switch 102. The video loopsets also 

With respect to FIG. 13, a high-level system view is enter the system in the form of MPEG streams (through a 

shown which implements a VCR backup. The Output Mod- backchannel, VBI, transmission media, etc.), bypass the 

ule 1303 sends TV signals to the VCR 1307. This allows the MPEG conversion cycle by the Input Module 101 and are 

user to record TV programs directly on to video tape. The written to the storage device 105 by the Media Switch 102. 

invention allows the user to queue up programs from disk to 15 ^ viewer interface program logic (executed by the CPU 

be recorded on to video tape and to schedule the time that the 106) commands the Media Switch 102 to retrieve a video 

programs are sent to the VCR 1307. Title pages (EPG data) loopset from the storage device 105. A video loopset is a 

can be sent to the VCR 1307 before a program is sent. three to four second (the length is dependent upon the 

Longer programs can be scaled to fit onto smaller video amount of information displayed andean, be longer) loop of 

tapes by speeding up the play speed or dropping frames. 20 vidcQ fe Cfeated ^ tha( the ending and bcginning sca mlessly 

The VCR 1307 output can also be routed back into the merge together to give the effect of a continuous video 

Input Module 1301. In this configuration the VCR acts as a stream as the system plays the loopset from beginning to 

backup system for the Media Switch 1302. Any overflow end, looping back to the beginning of the loopset each time 

storage or lower priority programming is sent to the VCR the end is reached. As detailed above, the Output Section 

1307 for later retrieval. 25 103 takes MPEG video loopset streams as input and pro- 

The Input Module 1301 can decode and pass to the duces an analog TV signal according to the NTSC, PAL, or 

remainder of the system information encoded on the Vertical other required TV standards. The Output Section's 103 OSD 

Blanking Interval (VBI). The Output Module 1303 can generator allows the program logic to overlay text and 

encode into the output VBI data provided by the remainder 3Q graphics on top of the resulting analog TV signal, 

of the system. The program logic may arrange to encode A lower level viewpoint of the system is shown in FIG. 7. 

identifying information of various kinds into the output The CPU 713 tells the Media Switch 701 that a specific 

signal, which will be recorded onto tape using the VCR video loopset must be retrieved from the storage device 710 

1307. Playing this tape back into the input allows the and sent to the MPEG decoder 715. On screen displays are 

program logic to read back this identifying information, 3S created by the CPU 713 and routed through the OSD 

such that the TV signal recorded on the tape is properly generator to the digital mixer 718. The digital mixer 718 

handled. For example, a particular program may be recorded allows video loopsets, on screen displays, and audio cues to 

to tape along with information about when it was recorded, be mixed and sent to the TV or monitor 716. 

the source network, etc. When this program is played back The invention's viewer interface reacts to user input 

into the Input Module, this information can be used to ^ through an input device such as the exemplary remote 

control storage of the signal, presentation to the viewer, etc. control shown in FIG. 14. With respect to FIG. 15, the user's 

One skilled in the art will readily appreciate that such a commands are processed through the Control Input Module 
mechanism may be used to introduce various data items to 1504. The viewer interface 1503 processes the input com- 
the program logic which are not properly conceived of as mands. Appropriate commands are issued (such as display- 
television signals. For instance, software updates or other 45 ing loopsets) to the Media Control 1501. On screen displays 
data may be passed to the system. The program logic are generated by the viewer interface 1503 and routed 
receiving this data from the television stream may impose through the Output Module 1505 as described above, 
controls on how the data is handled, such as requiring certain a viewer using this type of remote control 1401 presses 
authentication sequences and/or decrypting the embedded the TiVo button 1401 and the viewer interface displays a 
information according to some previously acquired key. 50 m enu as shown in FIG. 16. TiVo Central 1601 is a central 
Such a method works for normal broadcast signals as well, location that contains a list of areas that the viewer can visit 
leading to an efficient means of providing non-TV control and is easily accessed through a single button push on the 
information and data to the program logic. remote control. 

Additionally, one skilled in the art will readily appreciate The viewer interface displays video loopsets in the back- 
that although a VCR is specifically mentioned above, any 55 ground area of the screen on a TV or monitor. Here, the 
multimedia recording device (e.g., a Digital Video Disk- character 1602 in the upper left-hand portion of the screen 
Random Access Memory (DVD-RAM) recorder) is easily is a separate video loopset. The character's loopset animates 
substituted in its place. the character 1602 by giving the viewer the sense that the 

One skilled in the art will readily appreciate that other character is alive. His antennae move and he rocks from side 

applications may be substituted for those set forth herein 60 to side on his feet. Each element of the screen can be a 

without departing from the spirit and scope of the present separate video loopset. The subdued text's 1603 loopset 

invention. For example, the invention can be used in the rotates the text in a banner-like mode from the right side of 

detection of gambling casino crime. The input section of the the screen to the left side. The rest of the background details 

invention is connected to the casino's video surveillance are on another loopset. One loopset can be used for the entire 

system. Recorded video is cached and simultaneously output 65 background display if so desired. Video loopsets free the 

to external VCRs. The user can switch to any video feed and CPU from having to draw continuous animations. The 

examine (i.e., rewind, play, slow play, fast forward, etc.) a system simply plays the loopsets in the same manner as 
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playing any other MPEG stream, thereby offloading the A down arrow 1711 is displayed in the lower area of the 

CPU. Additionally, video loopsets are an inexpensive listing 1705 whenever the user has more information to 

method of displaying, high resolution graphics. scroll or page down through. An up arrow is displayed in the 

Any temporal elements (e.g., names, icons, location upper area of the listing 1705 whenever there is more 

indicators) are drawn onto the screen over the video loops 5 information to scroll or page up through. The user presses up 

using the OSD. Menu items such as Now Showing 1604 are or down on the button 1403 on the remote control 1401 to 

drawn over the video loopset. A highlight bar 1605 is used scroll up or down, respectively, through the listing. The 

to indicate the current menu item that can be selected by the channel button 1410 is pressed up or down to page up or 

user. down, respectively, through the listing. 

Highlight bars can be displayed using video loopsets. The 10 When the user presses on the right side of the button 1403 

highlight bar 1605 appears to be drawn onto the screen but on the remote control 1401, a more detailed program infor- 

is actually a video loopset. Each time the user presses a mation screen is displayed to the user. Referring to FIG. 18, 

button 1403 on the remote control to move the highlight bar this screen supplies the user with more information related 

1605, an appropriate video loopset is selected for that to the particular program. The user can choose to let the 

position. i5 program be deleted automatically by taking no action 1805, 

Alternatively, the highlight bar 1605 can be drawn over view it immediately 1801, delete it immediately 1803, ask 

the video loopsets in the same manner as a temporal item. the invention to save the program longer 1802, or save until 

Information is presented in a successive disclosure for- deleted by the user 1802. If the user asks the invention to 

mat. The user navigates through menus by moving to the save the program longer, then the yellow or yellow dot with 

right (by pressing right side of the button 1403 on the remote 2Q an exclamation point will disappear. The user can also save 

control) to obtain more information or to the left (by a program to an external VCR for archiving 1805. The 

pressing the left side of the button 1403 on the remote invention consistently displays the highlight bar 1806, whis- 

control) to see less information and return to the previous pering arrows 1810, 1811, 1812, and video loopsets 1807. A 

location. The select button 1404 selects the menu item and text description of the program 1809 is displayed, 

causes the appropriate action to be executed. ^ A down arrow 1813 is shown in the lower portion of the 

The background colors of each set of menus remains screen to indicate that the user can press down on the 

consistent throughout the user's experience. For example, channel button 1410 on the remote control 1401 to see a 

the background screen color for Now Showing is amber/ detailed program information screen for the next program on 

yellow and the background screen color for Network Show- the Now Showing list. An up arrow displayed in the upper 

cases is purple. The user intuitively knows what menu area 30 portion of the screen area indicates that the program list has 

he is in through the color cues. additional programs in that direction. This functionality 

Referring to FIGS. 14, 16, and 17, the invention provides allows the user to obtain the same information shown in the 

"whispering arrows" 1706, 1707, 1708, 1709 on each screen No w Showing listing 1705Jn_a more d eta iled format. 

that tell the user that more information is available in that irespeet^ 

particular direction. These arrows point up 1709, down 35 provides a bookmark function that allows the user to book- 

1707, left 1708, and right 1706. Aright arrow 1706 indicates mark a program where he left off. The CPU 713 records the 

that there is more detailed content that the user can access by frame of the program where the user stopped or the user 

pressing the right side of the button 1403 on the remote commands the system to place a bookmark. The Media 

control 1401. A left arrow 1708 indicates that a more general Switch 701 updates the CPU 713 on the status of the video 

level of detail exists that the user can access by pressing the 40 stream. For example, a user can watch the first half-hour of 

left side of the button 1403 on the remote control 1401. Up a two-hour program stored in the storage device 710 and 

1709 and down 1707 arrows indicate that the current list has then bookmark the program where he left off or he can place 

more items above or below, respectively, from the location bookmarks within the program to mark points of interest, 

that the user currently has highlighted with the highlight bar Alternatively, the invention automatically bookmarks the 

1710. If an arrow does not exist, then there is nowhere else 45 program for the user if the user exits viewing the program by 

to go in that direction. going to live TV or to the menu mode. The invention places . , ^t^H^ 

For example, the user simply highlights the Now Showing an indicator 1708 on the screen, indicating that a bookmark ^J*^J 0 ^ 

name 1604 and presses the right side of the button 1403 on has been saved. ^^8oQ h 

the remote control 1401. The Now Showing screen 1701 is The user can, at any time, access any of his bookmarks 

shown which has a list of programs 1705 that are displayed 50 and continue viewing the program from the bookmark, 

to the user in descending order with the most recently When a program is deleted from the storage device 710, the 

obtained program at the top of the list. The Now Showing associated bookmark(s) is also deleted. The user can also 

listing 1705 contains a list of shows that the user requested select and delete a specific bookmark or all bookmarks for 

the system to record and also programs that the system a program. Once the program is playing, the user can jump 

believes are of interest to the user. The system's list is based 55 to a bookmark using the jump button 1414 on the remote 

upon the program preferences that the user has expressed to control 1401 and press the select button 1406 to remove the 

the system using the thumbs up and thumbs down ratings bookmark. A bookmark is placed in the same manner by 

described below and are indicated with a TiVo logo 1712. A pressing the select button 1406 to create a bookmark, 

yellow dot 1702 is a warning indicator that indicates that a Bookmarks within a single program can be set for differ- 

program is going to expire and will be deleted from the hard 60 ent users. Remote controls are encoded for a specific user in 

drive in a short time (e.g., in 24 hours). A yellow dot with a household. This allows each person in the household to 

an exclamation point 1704 indicates that a program will be have a personal remote control. The advantage to having 

deleted within a much shorter time (e.g., within the next few individual remote controls is that parental controls, personal 

hours). Green dots 1703 indicate that the system will save preferences, and bookmarks are automatically activated 

the program until the user explicitly deletes it. A red dot 65 when each remote control is used. The CPU 713 notes that 

1713 indicates that the program is currently being saved on a bookmark belongs to a certain encoded remote control, 

the storage device. Each set of data are stored on the storage device 710. 
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The remote control identifies itself to the system via a With respect to FIG. 21, programs that the user has 

coded chip onboard the remote control. The Control Input indicated a preference for and other programs that the 

Module 1504 receives the remote control's command sig- system believes that the user is interested in (through a user 

nals. The viewer interface 1503 processes the remote con- profile) are displayed 2102 in the TiVo's Suggestions area 

trot's identification and checks the preferences on the stor- 5 2101. 

age device 1502 for any associated preference files. The ^. . „ „. . . , . t e 

■ • * c lL • ■ « £ The user can tell the system to record one instance of a 

viewer interface 1503 then uses the associated preference «, . / e u j n 

file (or default preference file if no match v£s found) pT0 ^ m l the neXl ™ ber of shoW1 ^ record dl occur " 
bookmark information for the user. Any bookmarks that do ? nces of a P r0 & r A am for a sel Ume P e »° d > « get a season pass 
not have associated programs stored on the storage device for a P">gram. A season pass tells the system that the user 
1502 are ignored and deleted. The viewer interface 1503 10 wanls 10 reconj each airin 6 of a program for the 
commands the Media Control 1501 to display programs with enlire season- The system notes, for example, that the 
start frames corresponding to the preference file bookmarks, program is shown every Monday at 8:00 PM and saves the 
if they exist. program on the storage device every Monday at 8:00 PM 
The encoded remote control can also be used for parental until lhe end of m e season. A season pass will only be offered 
controls. Specific remote control(s) can be set up so that 15 t0 the user if the program is episodic h nature, 
different levels of parental controls are engaged for each At anytime during the viewing of live television, the user 
remote control. Children, for example, will have their own is able to tell the system to save the program in progress, 
personal remote controls that are set up to not allow them to record the program the next time, if any, it is shown, or get 
watch any shows with greater than a G-rating. a season pass for the program. If the user is watching a show 
One skilled in the art will readily appreciate that, although 20 and tells the system to record the program in progress, then 
coded remote controls are mentioned as a method of access- the system will record the program from that point on and 
ing individual user preference files, other methods such as will add onto the saved recording (prepending) the portion 
manual selection can be used. of the program that has already passed and has been buff- 
Multiple bookmarks for a program are transparent to the ered. T° e user's choices will appear in his profile so he can 
user because the remote control that the user uses tells the 25 edit it later. 

system to only display and activate that particular user's Referring to FIGS. 22 and 23, a Showcase area 2201 

bookmarks. A user can also see other users' bookmarks if so contains program listings that certain television or cable 

desired. networks are promoting 2202. These are programs that the 

One skilled in the art will readily appreciate that the 3Q networks are currently promoting from their lineups. The 

invention's bookmarks can be applied to any video or audio user can, for example, move the highlight bar to the right and 

application wh ere the physical position in the material is look at the network listings. The user can choose NBC 2203 

rea'diiyJa'ske^^^ by highlighting that particular line and moving the highlight 

Users can indicate their preferences for a certain program. bar 2204 to tn c right. The list of program categories for NBC 

Auser can rate a particular program with either one, two, or 3S wil1 appear on the next screen 2301. The user can then move 

three thumbs up, indicating the degree that he likes the th e highlight bar 2303 to highlight a program category and 

program. One, two, or three thumbs down are used to men move the highlight bar 2303 to the right to see the 

indicate the degree that the user dislikes the program. The program listings on the next screen, 

degree that the user likes or dislikes the program increases Referring again to FIG. 19, a screen displaying the 

as the number of thumbs up or down increases (i.e., two ^ information for a program is shown. The user is given the 

thumbs up indicates a stronger preference than one thumbs thumbs rating if it exists 1901 along with a program descrip- 

up). tion and channel information. The user is presented with a 

The user can rate a program while he is watching it or ust of options such as: watch now 1902; record the episode 

viewing the program's, information. The accumulation of 1903; get a season pass 1904; view upcoming showings 

program ratings allows the system to save related programs 45 1905 i cancel the particular recording 1906; and view theme 

onto the system storage device. This influences the perfor- (which displays other shows in the same theme area), 

mance of the underlying system as described in application With respect to FIG. 24, TiVo's To Do List 2401 contains 

Ser. No. 08/089, 026owned by the applicant. a listing of the programs 2402 that the system is going to 

Referring to FIGS. 19, 20a, 206, and 20c the invention store on the system hard disk. A list of days beginning from 

displays the thumbs rating (if it exists) 1901 for a particular 50 toe current day is displayed. Each day has a corresponding 

program to the user whenever an episode of the program is list of programs that the system will store on the system hard 

viewed or the user looks at the program information 1908. disk. The user can select the day that he wants to query by 

A banner 2001 is displayed in the upper region of the screen highlighting the particular day and moving the highlight bar 

whenever the user changes channels, transitions to live TV, to the right. A list of programs that the system will record on 

or commands the banner to be displayed. 55 that particular day is displayed. Alternatively, the invention 

The user can rotate through three different levels of wil1 display the entire list of programs 2402 with the day 

banners, each successively containing more information 2404 that the program will be recorded listed in line with the 

about the program. The lowest level banner 2001 contains program name 2407. 

minimal information such as channel 2002, station ID 2003, A checkmark next to a program name indicates that the 

and time 2004. The second level banner 2005 displays, in 60 user has requested the system to record the program. Two 

addition to the information in the minimal banner 2001, checkmarks 2403 mean that the program 2407 is part of a 

information such as program title 2006, duration 2007, season pass. The user can check or uncheck any program on 

program MPAA or TV rating 2008, and thumbs rating. The the list. The programs that are checkmarked have a higher 

final level banner 2009 adds program text description 2010 priority to be stored on the system hard disk than the 

to the second level banner 2005. The program text descrip- 65 unchecked programs. 

tion 2010 is semi-transparent, allowing the user to watch the If the user attempts to checkmark too many programs, the 

progress of the program while reading the text. invention will notify the user that there will be insufficient 
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room on the system hard disk. The user is told what The cache bar 2602 expands, when the cache has not been 

programs should be freed up from the programs that are filled, to the right as more of the program is stored in the 

currently or planned to be saved on the system hard disk in circular cache. If the cache is filled, the cache bar 2602 

order to save the desired program. The user can accept the simply shifts to the right. When the cache bar 2602 reaches 

system's recommendations or he can obtain a listing of what 5 tnc en( \ 0 f tne right side of the trick play bar 2601, it will 

programs are currently stored and scheduled to be stored on shift to me lcft side of the trick play bar 26 01 so the right 

the storage device and can choose to remove the unwanted hand cnd of the cachc bar 260 2 is positioned in the trick play 

programs from the storage devLce^ The user selects the bar 2601 at the time mark 2 604. The slider 2 605 and position 

unwanted programs by placing an X next to the program s indicator 26Q8 within the trick k baf 2m ^ aJsQ &m 

name or he can let the system select the programs that will . . ... . , a t , 

be removed io in unison with the cache bar 2602, reflecting the current 

n c * » ie i_ j i a- * position in the cache. The time display at the right hand side 

Referring to FIG. 25, any program schedule conflicts are c *u * • i i u <m:m -n l i_ir L c 

displayed 2501 to the viewer immediately whenever a ™l of thc P 1 ^ bar Wll i be ° neba f h ° ur 

conflict arises. Such conflicts can be caused, for example, by he L tim ^ m /[ k 2604 at ^ middlc of l he tnck P la y bar 2601 

the viewer selecting two programs to be saved that are ( whcn half hour are used). 

shown at the same time or have overlapping times when only 15 The left half of the trick play bar 2601 can also display a 

one tuner is available. compressed time scale. The compressed time scale is used 

Referring again to FIG. 14, the viewer can also use the when a large circular cache is used. Sometimes it is not 

thumbs up 1405 and thumbs down 1404 buttons on the desirable to have the right half of the trick play bar 2601 

remote control 1401 to tell the system what actors or types indicating a time span larger than a half an hour because the 

of shows he does or does not prefer. For example, the viewer 20 cache bar 2602 shifts to the left when it reaches the end of 

can select actors from a list and place one, two, or three the right side and can be confusing to the user. 

thumbs up or down next to a particular actor's name. The The sllder 2605 can be movcd anywhere within the cachc 

viewer can access his favorite actor list and add or delete baf 2602 b the user Thc usef uses thc , un rcwind 

actors trom the list. Pavonte directors are designated in the t AM c * c . + f t . AA +* 

c . ~, t j. . , 1407, tast forward 1408, pause 1412, slow motion 1413, 

same way as favorite actors. The system adjusts to the 25 * *aia a • * * i iJi eL (t , - t - iL 

viewer's preferences and suggests programs with the actors, ^ l?*> ™ d "f**}™ bu "° nS i° P ™ * C 

directors, and types of shows that the user prefers. s lder 260 /' ™ e on ™ 4 g?* 0 ** the slider 2605 

With respect to FIGS. 7 and 26, as the user watches a at be f thc c " hc bar Whlle thc instant rc P l ^ 

program, a trick play bar 2601 is overlaid onto the live button 1415 causes the shder 2605 to reposition ten seconds 

video. The CPU 713 uses the OSD generator to display the 30 ( the L U L me „ s P a ? » s y? tcm adjustable) backwards into the 

trick play bar 2601 and its associated components through cachc bar 2602 > thcreb y lowing l * e user t° view a portion 

the digital mixer 718 to the TV or monitor. The trick play bar of thc P ro g ram ™ ^ samc manner as an instant replay 

2601 visually informs the user of the size of the circular °V™*s in football broadcasts. 

program cache is and, if the cache is not at capacity, how When the user watches a program that has been recorded, 

much of the cache is filled. The CPU 713 is informed by the 35 the trick P* av bar time indicator on the right hand side 2610 

Media Switch 701 of the frame that is being displayed and represents the total time of the program recording. The cache 

the cache status, bar 2602 fills the entire trick play bar 2601 indicating that 

The current program is stored in a circular cache as the program is stored entirely on the system. If a partial 

described above. The green cache bar 2602 inside of the program is stored, then the cache bar 2602 displays the 

trick play bar 2601 indicates how much of the circular cache 40 len S th of the P ro gram saved by the system. For example, if 

is filled. Time marks 2603, 2604 are displayed inside the the user recor ds a program after it has already started and the 

trick play bar 2601 giving the user a visual reference point system does not have the beginning of the program stored in 

from which to judge the current time and how far back in the cache > then the cache bar 2602 win show that the 

time the cache has recorded. The time marks 2603, 2604 can program starts a certain amount of time after the beginning 

be any increment of time needed, but usually are in half hour 45 of the program. The same type of behavior occurs when a 

or 15 minute increments. Every half hour (or selected program being recorded has prematurely ended. The cache 

increment), the cache bar 2602 slides to the left. The current bar 2602 will end at the point where the recording stopped, 

time is always between the time indicated at right hand side ^ slider 2605 Splays the amount of time (e.g., one hour) 

2610 of the trick play bar 2601 minus the time increment of in the program that the user is at. The mode indicator 2606 

the middle time mark 2604 when watching live television. 50 °P erates as described above and below. 

The entire length of the trick play bar 2601 is calculated by Referring to FIG. 27, the components around the trick 

subtracting the time indicated on the left hand side 2609 of play bar are shown. The trick play bar is shown by itself 

the trick play bar 2601 from the time indicated on the right 2701 and with the cache bar 2702, slider 2703, and a 

hand side 2610 of the trick play bar 2601. half-hour timing mark 2704. The mode indicator can indi- 

A slider 2605 moves along the trick play bar 2601 and on ss cate that a recording is n progress 2704. A unique aspect of 

top of the cache bar 2602. The slider 2605 along with the tne invention is that the user can move around the program 

position indicator 2608 are linked together and tell the user material that has been recorded while the actual recording is 

visually where his current position is within the program taking place. The slider 2703 can be moved to any point in 

material. The slider displays the time mark 2605 of the the cache bar 2702. The cache bar 2702 indicates the 

position. A mode indicator 2606 is positioned below the 60 progress of the recording. The mode indicator 2705 will 

slider 2605 and follows the slider's 2605 movement. The display any combination of record 2706 and play 2707, 

mode indicator 2606 displays whether the user is in play, rewind (three speeds) 2708, 2709, 2710, fast forward (three 

record, pause, slow play, fast play, fast forward (lx, 2x, and speeds) 2711, 2712, 2713, pause 2714, and slow motion 

3x), slow reverse play, slow reverse, and fast reverse (lx, 2715. Examples of record combined with 2x fast forward 

2x, and 3x) modes. The lx, 2x, and 3x speeds are adjustable 65 2716 and 3x fast forward 2717 are shown, 

by the system to be any variable desired (e.g., 2x, 16x, and The trick play bar and its associated components are 

32x). drawn over the program content for a short duration. The 



11/20/2003, EAST Version: 1.4.1 



US 6,642,939 Bl 

21 22 

trick play bar appears whenever the user activates any of the in lx, 2x, or 3x fast forward or reverse modes and then 

trick play features i.e., record, play, rewind, fast forward, automatically subtracts or adds, respectively, a time multiple 

pause, and slow motion. If the mode is either play or record, (depending upon the actual speed used for lx, 2x, or 3x) to 

then the trick play bar and its associated components will the frame where the transition was detected and positions the 

remain on the screen for a short time period. This removes 5 user al me correct frame. The system fine tunes the time 

any obstructions from the program material displayed on the multiple if it sees that the user is consistently correcting after 

screen and is for the convenience of the viewer. This time the fast forward or rewind mode stops, 

period is adjustable by the system. The trick play bar and its Another method initially tests the user's reaction time 

associated components may be displayed indefinitely if in an usin S a test vide0 - 11 ^ user to P ress the fast forward 

editing mode or a dedicated trick play display is used. 10 1408 or revcrse 1407 buttoa dunn S thc tcst vldco and then 

ddBa -ii • j , , , -i ii iii' l.. asks me user 10 position the video to the place that he 

expected the system to have been. THis time span is then 

over the trick play bar. These marks appear as, for example, used whenever lhe user ^ the fast forward or reverse 

a vertical bar that is colored, flagged, or labeled uniquely modes and fe ad justed with a multiple for each speed, 

giving the user visual cues that an index or bookmark exists A final method allows the ^ {Q si { sel a sensitivit 

m that position. The user can sequentially jump to each 15 ^ ^ the system win ^ as a comcliDn factor ^ 

index or bookmark indicator by pressing the jump button invention will subtract or add a multiple of the factor to thc 

1^14on lhe J^EPte^^ release frame whenever the user uses the fast forward or 

<«Ill*ysa>§^ rcversc modeSj respectively. 

One skilled in the art will readily appreciate that the One skilled in the art will readily appreciate that the 

invention's trick play bar can be applied to any video or 20 invention's overshoot correction can be applied to any video 

audio application where the physical position in the material 0 r audio application where the physical position in the 

is readily ascertainable e.g., DVDs, VCRs, MP3s, etc. material is readily ascertainable e.g., DVDs, VCRs, MP3s, 

Another unique aspect of the invention is that the user can etc. 

watch a pre-recorded program stored on the storage device with respect to FIGS. 7, 14, 28, 29, 30, and 31 the 

while the system is recording another program and storing it invention displays a program guide area 2801 to the user 

on the storage device. This simultaneous operation is a which is a list of the programs that are currently airing, was 

natural feature of the architecture of the invention. The aired, or is scheduled on live TV. Program guide information 

number of programs being recorded and stored on the ^ st0 red on the storage device 710. The CPU 713 parses the 

storage device is extended to the number of tuners or sources program guide information and creates program schedule 

available in the system. information. 

Referring again to FIGS. 14 and 15, the invention predicts The program guide area 2801 is semi-transparent and 

the position (overshoot correction) in the program material overlays on the actual broadcast program 2802 that the user 

where the user expects to be when the user stops the fast is currently watching. The user can see how the program 

forward or rewind modes. The user commands from the 35 2802 is progressing while he is browsing the program guide 

remote control 1401 are received by the Control Input schedules 2803, thereby allowing the user to immediately 

Module 1504. The user initially places the operational mode switch back to the program 2802; For example, the user 

into fast forward or reverse by pressing the fast forward switches to browsing the program guide 2803 while a 

button 1408 or the reverse button 1407. The viewer interface commercial break has occurred during the current program, 

1503 tells the Media Control 1501 to fast forward or reverse ^ The user sees when the commercial break ends and imme- 

the program material. Each successive press of the fast diately switches back to the program 2802. 

forward 1408 or reverse 1407 buttons places the system into A simple touch of the Live jy Guide button 1409 on the 

the lx, 2x, or 3x fast forward or reverse modes, respectively. remote control 1401 brings up a central program guide area 

When the user wants to stop the fast forward or reverse 2801 where the user navigates through the program schedule 

progression, he simply presses any other media control 45 information. The program guide area 2803 presents what is 

button, however the play button 1411 is most commonly 0 n live TV now, what is on all channels, and what is on a 

use d. particular channel that is coming up. The invention displays 

The viewer interface 1503 receives the command from the the program guide information in two different modes: two 

Control Input Module 1504 and tells the Media Control column or three column. Generally, only two columns are 

1501 to stop. The Media Control 1501 sends the viewer 50 shown on the screen at a time to declutter the display and 

interface 1503 the frame position where the program mate- present the information to the user in a friendlier format. The 

rial was stopped. The viewer interface then tells the Media information is not presented in the traditional channel/time 

Control 1501 to transition to the mode the user selected and grid format. 

passes the Media Control 1501 the frame to start the mode The two column mode 2803 displays the available chan- 

from. This frame start position is the present frame with an ss ne is i n a rotating endless list fashion in the left hand column 

overshoot correction factor added or subtracted from it. 2804 and the programs for the highlighted channel in the 

The invention adapts to the user by remembering how right hand column 2805. The user scrolls or pages up or 

much the user corrects (i.e., reverses or fast forwards) after down through the channel list by pressing the button 1403 up 

he stops the fast forward or reverse mode (in each speed), or down, or the channel button 1410 up or down, respec- 

Correction factors are calculated by taking the user's cor- so tively. The interface is consistent throughout all columns 

rections and setting the factors to the average, median, or with respect to scrolling and paging. Whispering arrows are 

any other method desired, for each speed. The system will also consistent in this interface, showing that more infor- 

adjust the correction factors if it observes that the user mation exists in the indicated direction. Information is also 

continues to make corrections. more detailed as the highlight bar is moved to the right 

The invention also uses a prediction method to correctly 65 (successive disclosure) as described above, 

place the user within the program upon transition out of The current time period 2807 is shown above the left 

either mode. The prediction method determines if the user is column 2804 on the screen. The time period 2807 is easily 
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changed by the user. The user chaages the time period 2807 The second form 3301 also lists the start time 3302 next 

through a single press of the back 1407 or forward 1408 to each of the program names 3303. The list 3304 continues 

button on the remote control 1401, moving the time period the time intervals 3302 by listing each half, quarter hour, or 

2807 backward or forward, respectively. Below the time selectable intervals. The duration of the program is indicated 

display is the listing of the channels 2804 available to the 5 by an arrow 3305 extending from the program start time 

user. Next to each channel number 2809 is the station ID 3302 down to the program end time 3306. This gives the 

2810 and the title 2811 of the current program that is being user a visual cue as to the duration of the program time slot, 

aired. The user moves the highlight bar 2812 over the The user can highlight a program and again move the 

channel that he is interested in and a description 2806, 2808 highlight bar to the right to obtain a screen such as the one 

of the current program that is showing on the channel 2809 10 shown in FIG. 18. The user is given choices to watch the 

is displayed. Apreferred embodiment of the invention places program now (if the program is currently airing) 1802, 

the description area 2806 above the two columns. As the record the episode 1803, get a season pass 1804, view a list 

user changes the time period 2807, the program titles 2811 0 f the upcoming showings of the program 1805, cancel the 

change to the names of the program that were, are, or will recording (if the program is being recorded or is scheduled 

be shown at that time period 2807. The programs in the right 15 to be recorded) 1806, or view programs in that theme area 

hand column 2805 will also change to correspond to the time 1807. 

period 2807. ^ three conjrnn mode adds a higher level column t0 tne 

Program information for the program currently showing two-column mode. This means that, conceptually, an addi- 

on the highlighted channel is displayed in the upper area tional column is added to the left of the channel column, 

2806, 2808 of the program guide area 2810. All of the data 20 although visually, only two columns are displayed at a time, 

that the user needs to know about the program that is Larger screens and higher resolutions will allow all three 

currently selected is displayed in the upper area 2806, 2808. columns to be displayed at once. 

This information includes: the program title; episode title; The program guide information is sorted in different 

program description; the actors or actresses appearing in the ways ^ c>g#> al i movies 2 901, favorite channels 3001, all 

program; any advisories; audio parameters; the genre that 25 channeIs 3V )l t a n sports , etCt The first column 3103 con- 

the program is in; start and stop times; the program's MPAA tains the sorting methods available to the user. The second 

or TV rating; the logo of the network that the program is column 3104 presents the available channels that correspond 

being broadcast on; the current time; if the program is t0 the sorting method with the description of the channel 

selected to be recorded; if it has been selected as a season cdumn consistent with that of the two-column method. The 

pass; if the user has expressed a thumbs up or down rating. 30 uger simply highlights the preferred sorting method with the 

The user moves the highlight bar to the right hand column highlight bar 3102. The sorted channels then appear in the 

2805 by pressing the right side of the button 1403 on the right hand column 3104. 

remote control 1401 allowing him to scroll through the The user can then move the highlight bar to the right hand 

programs 2805 for that particular channel. As each program column 3104 by pressing the right side of the button 1403 on 

is highlighted, the program's information (as described the remote control 1401 allowing him to scroll through the 

above) is displayed in the upper area 2806, 2808 of the channels 3104. The program information for the highlighted 

program guide area 2801. channel is displayed in the upper screen area of the program 

The right hand column 2805 displays a schedule of the guide area as described above. The user can once again 

programs for the particular channel. The schedule begins at ^ move the highlight bar to the right to obtain the two column 

the time 2807 indicated above the left column 2804. The channel/program format described above. This two column 

program name 2814 and start time 2813 are displayed. For format may differ (when a sort method other than all 

example, channel 2 is highlighted and the right hand column channels is selected) in that the channels displayed in the left 

shows all of the programs showing from the current or hand column are those that correspond to the sorting 

selected time. The user can move the highlight bar up and 45 method. 

down the list of programs 2805, scrolling through the time The user presses the Live TV Guide button 1409 again to 

slots for each day in the program guide information. As remove the program guide area 2801 from the screen and to 

described above, a page up or page down function is also return to the program viewing mode, 

easily accessed by the user. This saves the user the effort of The invention generates transitional sounds through the 

having to scroll through the program list in either column. 5Q digital mixer 718, as described above, whenever the user 

The channel number and ID 2815 are displayed above the moves the highlight bar to another area. Warning sounds 

right hand column 2805. The user changes the channel occur when the user attempts an action that is not allowed, 

number 2815 through a single press of the back 1407 or e.g., when the user tries to move the highlight bar to an area 

forward 1408 button on the remote control 1401, moving the that does not exist, i.e., where a whispering arrow is not 

channel number 2815 backward or forward, respectively, 55 displayed. These sounds can be turned on or off by the user, 

through the channel list; The channel list in the left hand Although the invention is described herein with reference 

column 2804 follows the user's channel selections, scrolling to the preferred embodiment, one skilled in the art will 

backward or forward in the channel list. The program list in readily appreciate that other applications may be substituted 

the right hand column 2805 changes to the programs asso- for those set forth herein without departing from the spirit 

ciated with the channel number 2815 selected by the user, 60 and scope of the present invention. Accordingly, the inven- 

starting at the time indicated 2807 above the left hand tion should only be limited by the Claims included below, 

column 2804. What is claimed is: 

The program list in the right hand column 2805 can be 1- A process for presenting interactive program guide 

shown in two intuitive forms. The first form 3201 lists the information to a user, comprising the steps of: 

start time 3202 of each program next to the program name 65 providing a program guide area; 

3203. The list 3204 is in descending order from the most wherein said program guide area is semi- transparent and 

recent time to the latest time. overlays a broadcast program that the user is currently 
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watching, allowing the user to see the progress of the 

broadcast program; 
receiving user command input; 
displaying a first column in said program guide area; 
said first column displays available program channels in 

a rotating endless channel list; 
wherein the user scrolls or pages up or down said channel 

list; 

displaying a second column in said program guide area; 
said second column displays a program list for a specific 
channel; and 

wherein the user scrolls or pages up or down said program 
-list. 

2. The process of claim I, further comprising the step of: 
highlighting an element in a column; and 

said highlight step is responsive to a user's commands. 

3. The process of claim 2, wherein said highlight step 
displays a highlight bar to highlight an element. 

4. The process of claim 2, wherein said second column 
displays the program list for a channel highlighted by the 
user. 

5. The process of claim 2, wherein whispering arrows are 
displayed when information exists in the indicated direction 
and wherein information is more detailed as the highlight is 
moved to the right. 

6. The process of claim 2, further comprising the step of: 
displaying a description of a program highlighted by the 

user in said program guide area. 

7. The process of claim 6, wherein said program descrip- 
tion is displayed above said first and said second columns in 
said program guide area. 

8. The process of claim 2, further comprising the step of: 
displaying the channel number and ID above said second 

column; and 

wherein said channel number and ID are modifiable by 
the user. 

9. The process of claim 8, wherein said program list 
changes to the programs associated with the channel number 
highlighted by the user, starting at the time indicated above 
said first column. 

10. The process of claim 2, wherein the user highlights a 
program in said second column and moves said highlight to 
the right to obtain a detailed information screen for said 
program. 

11. The process of claim 1, further comprising the step of: 
displaying a start time above said first column; and 
wherein said start time is modifiable by the user. 

12. The process of claim 11, wherein said channel list 
comprises channel numbers, channel IDs and the name of 
the program playing during said start time on each channel 
number. 

13. The process of claim 11, wherein said second column 
displays programs for the selected channel starting from said 
start time. 

14. The process of claim 1, further comprising the step of: 
displaying the channel number and ID above said second 

column; and 

wherein said channel number and ID are modifiable by 
the user. 

15. The process of claim 14, wherein said channel list 
follows the user's channel selections, scrolling backward or 
forward in said channel list. 

16. The process of claim 1, wherein said program list lists 
the start time of each program next to the program name, 
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said program list is in descending order from the most recent 
time to the latest time. 

17. The process of claim 1, wherein said program list lists 
the start time of each program next to the program name and 
5 continues the intermediate time intervals by listing each 
half, quarter hour, or selectable intervals, and wherein the 
duration of each program is displayed using an indicator 
extending from the program start time down to the program 
end time. 

10 18. A process for presenting interactive program guide 
information to a user, comprising the steps of: 
providing a program guide area; 

wherein said program guide area is semi- transparent and 
overlays a broadcast program that the user is currently 
35 watching, allowing the user to see the progress of the 
broadcast program; 
receiving user command input; 
displaying a first column in said program guide area; 
20 said first column displays channel sorting methods avail- 
able to the user; 
displaying a second column in said program guide area; 
said second column displays available program channels 
in a rotating endless channel list; 
25 wherein the user scrolls or pages up or down said channel 
list; 

displaying a third column in said program guide area; 
said third column displays a program list for a specific 
3Q channel; and 

wherein the user scrolls or pages up or down said program 
list. 

19. The process of claim 18, wherein two columns are 
displayed at a time. 
3S 20. The process of claim 19, wherein said first column and 
said second column are displayed in said program guide 
area. 

21. The process of claims 18, further comprising the step 
of; 

4Q highlighting an element in a column; and 

said highlight step is responsive to a user's commands. 

22. The process of claim 21, wherein said second column 
displays the available channels that correspond to the sorting 
method highlighted by the user. 

45 23. The process of claim 21, wherein the user moves the 
highlight to the right of said second column to display said 
second and said third columns in said program guide area. 

24. The process of claim 21, wherein said highlight step 
displays a highlight bar to highlight an element. 

50 25. The process of claim 21, wherein said third column 
displays the program list for a channel highlighted by the 
user. 

26. The process of claim 21, wherein whispering arrows 
are displayed when information exists in the indicated 

55 direction and wherein information is more detailed as the 
highlight is moved to the right. 

27. The process of claim 21, further comprising the step 
of: 

displaying a description of a program highlighted by the 
60 user in said program guide area. 

28. The process of claim 27, wherein said program 
description is displayed in the upper portion of said program 
guide area. 

29. The process of claim 21, further comprising the step 
65 of: 

displaying the channel number and ID above said third 
column; and 
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wherein said channel number and ID are modifiable by 41. The apparatus of claim 40, wherein said highlight 

the user. module displays a highlight bar to highlight an element. 

30. The process of claim 29, wherein said program list 42. The apparatus of claim 40, wherein said second 
changes to the programs associated with the channel number column displays the program list for a channel highlighted 
highlighted by the user, starting at the time indicated above 5 by the user. 

said first column. 43. The apparatus of claim 40, wherein whispering arrows 

31. The process of claim 21, wherein the user highlights are displayed when information exists in the indicated 
a program in said third column and moves said highlight to direction and wherein information is more detailed as the 
the right to obtain a detailed information screen for said highlight is moved to the right. 

program. 10 44. The apparatus of claim 40, further comprising: 

32. The process of claims 18, further comprising the step a module for displaying a description of a program 
of: highlighted by the user in said program guide area. 

displaying a start time above said second column; and 45. The apparatus of claim 44, wherein said program 

wherein said start time is modifiable by the user. description is displayed above said first and said second 

33. The process of claim 32, wherein said channel list 15 columns in said program guide area. 

comprises channel numbers, channel IDs and the name of 46 - ^ apparatus of claim 40, further comprising: 

the program playing during said start time on each channel a module for displaying the channel number and ID above 

number. Sfl id second column; and 

34. The process of claim 32, wherein said third column wherein said channel number and ID are modifiable by 
displays programs for the selected channel starting from said 20 the user. 

start time. 47. The apparatus of claim 46, wherein said program list 

35. The process of claim 18, further comprising the step changes to the programs associated with the channel number 
of: highlighted by the user, starting at the time indicated above 

displaying the channel number and ID above said third sa *d ^ rst colum n. 

column- and 48. The apparatus of claim 40, wherein the user highlights 

wherein said channel number and ID are modifiable by a P«W«mi"> "M second column and moves said highlight 

t j 3e user J to the right to obtain a detailed information screen for said 

36. The process of claim 35, wherein said channel list ^^^.2!* . c i * ^ r. 

follows the user's channel selections, scrolling backward or 30 49 * ^ a P paratUS ° f claim 40 ' farther com P risin S' 

forward in said channel list. a modulc for Splaying a start time above said first 

37. The process of claim 18, wherein said program list column; and 

lists the start time of each program next to the program wherein said start time is modifiable by the user, 

name, said program list is in descending order from the most 50 ™ e apparatus of claim 49, wherein said channel list 

recent time to the latest time. 35 comprises channel numbers, channel IDs and the name of 

38. The process of claim 18, wherein said program list the Program playing during said start time on each channel 
lists the start time of each program next to the program name number. 

and continues the intermediate time intervals by listing each 51 ^ W^atus of claim 49, wherein said second 

half, quarter hour, or selectable intervals, and wherein the column displays programs for the selected channel starting 

duration of each program is displayed using an indicator 40 ^ rom sa ^ start ^me. 

extending from the program start time down to the program 52 - ^ apparatus of claim 39, further comprising: 

end time. a module for displaying the channel number and ID above 

39. An apparatus for presenting interactive program guide said second column; and 

information to a user, comprising: wherein said channel number and ID are modifiable by 

a program guide area; 45 user 

,„u -j „ • j • . , . 1 53. The apparatus of claim 52, wherein said channel list 

wherein said program guide area is semi-transparent and „ 1( . , . , , . 

_ 1 „, fc . „ L„7j m# , ™ *u * *u • *i follows the user s channel selections, scrol ing backward or 

overlays a broadcast program that the user is currently r j ■ -j . . 

„, t u- 11 *u * (L c *i_ forward in said channel list. 

watching, allowing the user to see the progress of the CA c 1 • ™ t. 

broadcast program- . ™ e a PP a f atus of claim 39 > wherein said program list 

so lists tQ e starl lime of each program next to the program 

a module for receiving user command input; Damej said program list fa in descending order from lhe most 

a module for displaying a first column in said program recent time to the latest time. 

guide area; 55, The apparatus of claim 39, wherein said program list 

said first column displays available program channels in lists the start time of each program next to the program name 

a rotating endless channel list; 5S and continues the intermediate time intervals by listing each 

wherein the user scrolls or pages up or down said channel nalf > quarter hour, or selectable intervals, and wherein the 

list; duration of each program is displayed using an indicator 

a module for displaying a second column in said program ext ? ndin S ftom the P'°&™ start time down to the program 

guide area; en ^ ,ime - c ... 

, , fin 56. An apparatus tor presenting interactive program euide 

said second column displays a program lost for a specific information to a ^ comprising: 

channel; and . , 

a program guide area; 

wherein the user scrolls or pages up or down said program wherein said program guide area is scmi . transparcnt and 

Jn !L . * 1 • m L •■ overlays a broadcast program that the user is currently 

40. The apparatus of claim 39, further comprising: fi5 watc hing, allowing the user to see the progress of the 
a module for highlighting an element in a column; and broadcast program; 

said highlight module is responsive to a user's commands. a module for receiving user command input; 
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a module for displaying a first column in said program 72. The apparatus of claim 70, wherein said third column 

guide area; displays programs for the selected channel starting from said 

said first column displays channel sorting methods avail- start time. 

able to the user; 73. The apparatus of claim 56, further comprising: 

a module for displaying a second column in said program 5 a module for displaying the channel number and ID above 

guide area; said third column; and 

said second column displays available program channels wherein said channel number and {D afe modifiablc by 

m a rotating endless channel list; me uscr 

wherein the user scrolls or pages up or down said channel 74 Thc apparatus of claim 73> whercin said channel list 

ust; 30 follows the user's channel selections, scrolling backward or 

a module for displaying a third column in said program forward in said channel list. 

guide area; 75 The apparatus of claim 56, wherein said program list 

said third column displays a program list for a specific lists the start time of each program next to the program 

channel; and name, said program list is in descending order from the most 

wherein the user scrolls or pages up or down said program 15 recent time to the latest time. 

list. 76. The apparatus of claim 56, wherein said program list 

57. The apparatus of claim 56, wherein two columns are lists the start time of each program next to the program name 
displayed at a time. and continues the intermediate time intervals by listing each 

58. The apparatus of claim 53, wherein said first column half, quarter hour, or selectable intervals, and wherein the 
and said second column are displayed in said program guide 20 duration of each program is displayed using an indicator 
area. extending from the program start time down to the program 

59. The apparatus of claims 56, further comprising: end time. 

a module for highlighting an element in a column; and 77. A program storage medium readable by a computer, 

said highlight module is responsive to a user's commands. tangibly embodying a program of instructions executable by 

60. The apparatus of claim 59, wherein said second 25 tne computer to perform method steps for presenting inter- 
column displays the available channels that correspond to active program guide information to a user, comprising the 
the sorting method highlighted by the user. steps of: 

61. The apparatus of claim 59, wherein the user moves the providing a program guide area; 

highlight to the right of said second column to display said 3Q wherein said program guide area is semi-transparent and 

second and said third columns in said program guide area. overlays a broadcast program that the user is currently 

62. The apparatus of claim 59, wherein said highlight watching, allowing the user to see the progress of the 
module displays a highlight bar to highlight an element. broadcast program; 

63. The apparatus of claim 59, wherein said third column receiving user command input- 
displays the program list for a channel highlighted by the 35 displaying a first column in sa ' id program ^ area; 

US 64.The apparatus of claim 59, wherein whispering arrows said first colum J n ^P 1 ^ 5 available P ro S ram chanDels in 

are displayed when information exists in the indicated a rotaUn £ endless channel list; 

direction and wherein information is more detailed as the wherein the user scrolls or pages up or down said channel 

highlight is moved to the right. ns *i 

65. The apparatus of claim 59, comprising: 40 displaying a second column in said program guide area; 
a module for displaying a description of a program said second column displays a program list for a specific 

highlighted by the user in said program guide area. channel; and 

66. The apparatus of claim 65, wherein said program wherein the user scrolls or pages up or down said program 
description is displayed in the upper portion of said program 45 list. 

guide area. 78. The method of claim 77, further comprising the step 

67. The apparatus of claim 59, further comprising: of: 

a module for displaying the channel number and ID above highlighting an element in a column; and 

said third column; and sa j d highlight step is responsive to a user's commands. 

wherein said channel number and ID are modifiable by 50 79. The method of claim 78, wherein said highlight step 

me user - displays a highlight bar to highlight an element. 

68. The apparatus of claim 67, wherein said program list 80. The method of claim 78, wherein said second column 
changes to the programs associated with the channel number displays the program list for a channel highlighted by the 
highlighted by the user, starting at the time indicated above user. 

said first column. 55 81. The method of claim 78, wherein whispering arrows 

69. The apparatus of claim 59, wherein the user highlights are displayed when information exists in the indicated 
a program in said third column and moves said highlight to direction and wherein information is more detailed as the 
the right to obtain a detailed information screen for said highlight is moved to the right. 

program. 82. The method of claim 78, further comprising the step 

70. The apparatus of claim 56, further comprising; 60 0 f: 

a module for displaying a start time above said second displaying a description of a program highlighted by the 

column; and user in said program guide area, 

wherein said start time is modifiable by the user. 83. The method of claim 82, wherein said program 

71. The apparatus of claim 70, wherein said channel list description is displayed above said first and said second 
comprises channel numbers, channel IDs and the name of 65 columns in said program guide area. 

the program playing during said start time on each channel 84. The method of claim 78, further comprising the step 

number. of: 
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displaying the channel number and ID above said second 
column; and 

wherein said channel number and ID are modifiable by 
the user. 

85. The method of claim 84, wherein said program list 
changes to the programs associated with the channel number 
highlighted by the user, starting at the time indicated above 
said first column. 

86. The method of claim 78, wherein the user highlights 
a program in said second column and moves said highlight 
to the right to obtain a detailed information screen for said 
program. 

87. The method of claim 80, further comprising the step 

of: 

displaying a start time above said first column; and 
wherein said start time is modifiable by the user. 

88. The method of claim 87, wherein said channel list 
comprises channel numbers, channel IDs and the name of 
the program playing during said start time on each channel 
number. 

89. The method of claim 87, wherein said second column 
displays programs for the selected channel starting from said 
start time. 

90. The method of claim 77, further comprising the step 

of: 

displaying the channel number and ID above said second 
column; and 

wherein said channel number and ID are modifiable by 
the user. 

91. The method of claim 90, wherein said channel list 
follows the user's channel selections, scrolling backward or 
forward in said channel list. 

92. The method of claim 77, wherein said program list 
lists the start time of each program next to the program 
name, said program list is in descending order from the most 
recent time to the latest time. 

93. The method of claim 77, wherein said program list 
lists the start time of each program next to the program name 
and continues the intermediate time intervals by listing each 
half, quarter hour, or selectable intervals, and wherein the 
duration of each program is displayed using an indicator 
extending from the program start time down to the program 
end time. 

94. A program storage medium readable by a computer, 
tangibly embodying a program of instructions executable by 
the computer to perform method steps for presenting inter- 
active program guide information to a user, comprising the 
steps of: 

providing a program guide area; 

wherein said program guide area is semi-transparent and 
overlays a broadcast program that the user is currently 
watching, allowing the user to see the progress of the 
broadcast program; 

receiving user command input; 

displaying a first column in said program guide area; 

said first column displays channel sorting methods avail- 
able to the user; 

displaying a second column in said program guide area; 

said second column displays available program channels 
in a rotating endless channel list; 

wherein the user scrolls or pages up or down said channel 
list; 

displaying a third column in said program guide area; 
said third column displays a program list for a specific 
channel; and 
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wherein the user scrolls or pages up or down said program 
list. 

95. The method of claim 94, wherein two columns are 
displayed at a time. 
5 96. The method of claim 95, wherein said first column and 
said second column are displayed in said program guide 
area. 

97. The method of claims 94, further comprising the step 

10 of: 

highlighting an element in a column; and 

said highlight step is responsive to a users commands, 

98. The method of claim 97, wherein said second column 
displays the available channels that correspond to the sorting 

15 method highlighted by the user. 

99. The method of claim 97, wherein the user moves the 
highlight to the right of said second column to display said 
second and said third columns in said program guide area. 

2Q 100. The method of claim 97, wherein said highlight step 
displays a highlight bar to highlight an element. 

101. The method of claim 97, wherein said third column 
displays the program list for a channel highlighted by the 
user. 

25 102. The method of claim 97, wherein whispering arrows 
are displayed when information exists in the indicated 
direction and wherein information is more detailed as the 
highlight is moved to the right. 

103. The method of claim 97, further comprising the step 

30 of: 

displaying a description of a program highlighted by the 
user in said program guide area. 

104. The method of claim 103, wherein said program 
35 description is displayed in the upper portion of said program 

guide area. 

105. The method of claim 97, further comprising the step 

of: 

displaying the channel number and ID above said third 
40 column; and 

wherein said channel number and ID are modifiable by 
the user. 

106. The method of claim 105, wherein said program list 
changes to the programs associated with the channel number 

45 highlighted by the user, starting at the time indicated above 
said first column. 

107. The method of claim 97, wherein the user highlights 
a program in said third column and moves said highlight to 

5Q the right to obtain a detailed information screen for said 
program. 

108. The method of claims 94, further comprising the step 

of: 

displaying a start time above said second column; and 
55 wherein said start time is modifiable by the user. 

109. The method of claim 108, wherein said channel list 
comprises channel numbers, channel IDs and the name of 
the program playing during said start time on each channel 
number. 

110. The method of claim 108, wherein said third column 
displays programs for the selected channel starting from said 
start time. 

111. The method of claim 94, further comprising the step 

65 0f: 

displaying the channel number and ID above said third 
column; and 
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wherein said channel number and ID are modifiable by 
the user. 

112. The method of claim 111, wherein said channel list 
follows the user's channel selections, scrolling backward or 
forward in said channel list. 

113. The method of claim 94, wherein said program list 
lists the start time of each program next to the program 
name, said program list is in descending order from the most 
recent time to the latest time. 
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114. The method of claim 94, wherein said program list 
lists the start time of each program next to the program name 
and continues the intermediate time intervals by listing each 
half, quarter hour, or selectable intervals, and wherein the 
duration of each program is displayed using an indicator 
extending from the program start time down to the program 
end time. 
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